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(54) Optimization of adaptive filter tap settings for sub band acoustic echo cancellers in 
teleconferencing 



(57) A subband acoustic echo canceller for a tele- 
communications teleconferencing room is equiped with 
subband adaptive filters and filter taps associated with 
said subbands. A data store is provided containing a 
weight list for controlling allocation of the filter taps 
among the subbands. An optimum tap profile as deter- 
mined by the weights is a composite of room acoustic 
impulse response and weighting adjustments based on 
one or more measures of perceived human acoustic sen- 
sitivity experienced by far-end users. An active periodic 
adjustment of the weights responsive to detection of sib- 
ilant energy in the incoming path further improves echo 
cancellation. Active measurement and updating of the 
room acoustic impulse response provides further refine- 
ment. 
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Description Summary of The Invention 



Field of The Invention 

This invention relates to subtend acoustic echo can- 
cellation in telecommunications speech teleconferenc- 
ing systems; and more specifically to a novel scheme for 
choosing the number of taps in the adaptive filters used 
in such systems based on weighting functions which are 
a composite of both physical and human perceptual sen- 
sitivity factors. 

Background of The Invention 

In modern full-duplex teleconferencing systems, 
subband acoustic echo cancellers are used to cancel 
reverberant sound incident at the local room micro- 
phone, thus to avoid the far end user having to hear ech- 
oes of his/her own voice. These devices model the 
character of the open air sound paths between the micro- 
phone and the loudspeaker, by decomposing the wide- 
band speech signals into several disjoint subbands each 
associated with an independent adaptive filter; and 
developing an impulse response function for each sub- 
band to emulate the component of the room impulse 
response contained within each subband. 

A subband acoustic echo canceller contains a 
number of adaptive filter "taps" that are allocated among 
the subbands. The allocation can be uniform (same 
number of taps in each band); or nonuniform. The max- 
imum number of feasible taps as summed over all sub- 
bands is a known function of the real-time processing 
capability of the hardware employed in the echo cancel- 
ler. Given this constraint, it is critical that the feasible 
number of taps be distributed over all subbands in some 
kind of optimized filter tap "profile" calculated to remove 
the maximum possible reverberent acoustic energy. A 
typical tap profile may, for example, be based on an 
assessment of maximum echo path compensation capa- 
bility vs. subband (i. e., frequency) number. This type of 
tap profile is derived from data reflecting known gross 
characteristics of typical room acoustic impulse 
response functions, which takes into account the fact that 
the magnitude of the response decays with increasing 
time and increasing frequency. Using this approach, it 
has been common practice in setting the echo canceller 
filter tap profiles to simply allocate most of the taps to the 
lower-most subbands, with the tap allocation in each 
subband decreasing roughly exponentially with increas- 
ing subband number. This allocation "weights" the lower 
frequencies with more filter taps in those subbands; and 
is carried out using a table of tap counts stored in the 
subband acoustic echo canceller. 

One shortcoming of this traditional tap allocation 
and weighting scheme is the absence of any indicia of 
human perceptual phenomena in the weightings. These 
phenomena significantly affect the degree to which com- 
ponents of the echo are actually perceived by and annoy 
the far-end talker. 



An approach is herein described for incorporating 
indicia of human perceptual phenomena into the adap- 

5 tive filter tap allocation table, or profile, of a subband 
acoustic echo canceller that is widely applicable to most 
users. This invention recognizes in particular that a crit- 
ical factor in whether or not an echo will be perceived by 
the far-end speaker is the relative perceived loudness of 

10 reverberating speech as produced by the near-end tel- 
econference room. 

In one embodiment, the invention provides adaptive 
filter tap profiles for a subband acoustic echo canceller 
that are a function of both the room's physical acoustic 

is attributes and human perceptual sensitivities relating to 
the quality of perceived speech loudness. Data on the 
relative power spectrum for male and female speakers 
is incorporated into the tap weighting function, to con- 
centrate taps in the peak energy containing lower sub- 

20 bands. In a variation of this idea, the tap profile may be 
further optimized by responding in the short term to com- 
ponents of transitory unvoiced speech, and in particular 
sibilants ("s" sounds). These speech components exhibit 
power in the frequencies above 2 kHz that is comparable 

25 to the peak relative power levels found in the lower-most 
subbands of the long-term male/female speech power 
spectrum. Reverberant energy generated in the room 
during teleconferencing by these sibilant components 
may therefore be removed more effectively by actively 

30 shifting the tap profile to favor the upper-most bands. 

Other and further variations of the present tap opti- 
mization improvements are described herein below. 

PeSftription pf THE Drawing 

35 

FIG. 1 is a functional diagram of a generally conven- 
tional subband acoustic echo canceller deployed in 
a teleconference room setting; 
FIG. 2 is a graph presenting a long-term composite 
40 relative speech power spectrum for men and 
women; 

FIG. 3 is a graph presenting an equal loudness con- 
tour of human hearing; 

FIG. 4 is a graph presenting a generally accepted 
45 measure of the echo attenuation required to meet a 
20% annoyance level; 

FIG. 5 is a graph of a specific tap corresponding to 
long-term composite speech loudness transforma- 
tion , and comprises a loudness transformation of the 

so graph of FIG. 2; 

FIG. 6 is a graph of a tap corresponding to the loud- 
ness curve of human hearing, and comprises a loud- 
ness transformation of the graph of FIG. 3; 
FIG. 7 is a graph of a specific tap corresponding to 

55 echo perception, and comprises a loudness trans- 
formation of the graph of FIG. 4; 
FIG. 8 is a chart illustrating the invention's improve- 
ments upon an exemplary desired uniform filter tap 
profile; 
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FIG. 9 is a chart illustrating the invention's improve- 
ments upon an exemplary modeled filter tap profile; 
FIG. 10 i a functional diagram similar to FIG. 1 . with 
improvements added according to the invention; 
FIG. 1 1 is a block diagram of an active circuit for fur- 
ther improving filter tap profile to eliminate certain 
short-term speech components from acoustic echo; 
and 

FIG. 12 is a process diagram summarizing the data 
processing steps of the invention. 

Detailed Description of An Illustrative Embodiment 

Fig. 1 shows a generalized subband acoustic echo 
canceller 10 operating in a room 1 1 which may be a tel- 
econferencing room. Canceller 10 is serially connected 
to a telecommunications network (not shown) through 
incoming line 1 6 and outgoing line 25. Room reverbera- 
tive surfaces 1 2 def one multiple echo paths which depend 
on room geometry; one such path denoted 13 is shown. 
Speech from the far-end emanating from room loud- 
speaker 1 4 travels along path 13 (and others); and enters 
microphone 15 with various time delays. Canceller 10 
contains conventional adaptive elements including sub- 
band analyzer 17 connected to incoming path 16 via line 
18. and room subband analyzer 22 connected to micro- 
phone 15. Subband adaptive filter bank 19 contains a 
plurality of filter taps denoted ni...n M . where M is the 
number of discrete subbands. The room subband ana- 
lyzer 22 is set up to have the same subband structure as 
that of analyzer 17. Analyzer 22 receives signals from 
microphone 15 which include the undesired echoes of 
the far-end speech. The desired output of filter 19 is a 
set of signals which, based on the assumed impulse 
response of the room 1 1 and the feasible number of filter 
taps in the profile and their weightings as summed over 
all subbands, optimally subtractively combines with the 
output of analyzer 22 in summer 23. The resultant sig- 
nals containing reduced far-end speaker echo energy 
content are fed to subband synthesizer 24 which resyn- 
thesizes the full-band outbound (transmit) speech signal 
from the echo-cancelled subband signals. The relatively 
echo-free signal is transmitted to the network via outgo- 
ing signal path 25. A more detailed description of adap- 
tive filters used in acoustic echo cancellers may be 
found, for example, in the article "A Twelve-Channel Dig- 
ital Voice Echo Canceller, D. L Duttweiler, IEEE Trans. 
Comm., COM-26, No. 5, May 1978, pp. 647-653, which 
pages are herein incorporated by reference. 

Echoes are manifest only in regions of the audio 
spectrum for which the received far-end signal provides 
excitation. Where the far- end signals are speech, the 
known long-term characteristics of speech can in 
accordance with the invention allow an improvement in 
the shaping of the tap profile. Fig. 2 illustrates the relative 
power spectrum of speech for a composite of male and 
female speakers. The curve shows that the region below 
1000 Hz contains the large preponderance of speech 
energy. The tap profile can therefore be improved, i. e.. 



optimized, by a loudness filter tap weighting function 
concentrated in this region. 

One approach for realizing a loudness weighting 
function is illustrated hereinafter, in the framework of a 

5 "least squares" optimization technique. It should be 
understood, however, that the profile optimization may 
also be cast in other frameworks, such as in an integer 
linear programming problem. 

For an /If subband tap profile, let /. £=1, 2, 3..../W, 

io denote the subband index; and let d, denote the number 
of taps in the ideal or desired filter tap profile for subband 

/. The desired profile {di. d 2 d M ] is that derived, or 

measured from, the physical acoustic nature of the near- 
end room. 

is The constrained least-squares minimization prob- 
lem is expressed as follows: 

M 

min £w,(d/-n,) 2 (1a) 
20 [nf i=1 , M} subject to the two constraints 

n,> =0, for all /, (1b) 



25 M 

J^n^N T (1c) 

In the preceding, the terms [nj are the optimum 
subband filter tap counts for minimizing the weighted 

30 squared-error functional in (1a), subject to the non-neg- 
ativity and profile size constraints in (1b) and (1c). The 
weights {wj are "importance" factors used to control the 
relative error in the solution as a function of subband 
number; and in the present invention are composites of 

35 both physical and perceptual factors. 

Formulated in this manner, the optimum filter tap 
profile may be obtained as the solution to a constrained 
integer quadratic programming problem, an exposition 
of which is found in Optimization by Vector Space Meth- 

40 ods, D. G. Luenberger, John Wiley & Sons, Inc., New 
York, 1969. This publication to the extent relevant is 
hereby incorporated by reference. 

Although numerical procedures are known in the art 
for solving a constrained integer quadratic programming 

45 problem, a closed-form solution particularly advanta- 
geous in the present context of optimization of adaptive 
filter tap profiles for subband acoustic echo cancellers 
may be realized by making a simplification. Specifically, 
real (floating point) numbers are substituted for the inte- 

so ger subband tap counts n r Then, once optimal real num- 
bers n, are determined, they are rounded to integers and 
resolved with constraint (1c) above: With real numbers 
substituted for the n„ the solution to the term (1a) follows 
readily from the theory of constrained optimization of 

55 convex functional in accordance with the above-cited 
publication. 

The realizing of a composite weighting function in 
accordance with the invention using the least-squares 
optimization technique, is next described. 



BNSDOCID: <EP 0719028A2J_> 



EP 0 719 028 A2 



6 



Fig. 3 shows a graph of the equal loudness contour 
of human hearing, calibrated to a 50 dB-sound power 
level ("SPL") source at 1000 Hz. Fig. 4 shows the echo 
attenuation required to meet a generally accepted 20% 
annoyance level. For a given echo delay, the ordinate 
value indicates the required attenuation in decibels of an 
echo, relative to its source, so as not to annoy more than 
20 % of a population. Both Figs. 3 and 4 are found in 
Sound System Engineering, by D. Davis and C. Davis, 
H. W. Sams &Co., Carmel, Indiana, 1987. 

When expressed in terms of relative power, the sen- 
sitivity curves of Figs. 2-4 convey differences in sound 
pressure level. Important to the ear of the far-end user, 
however, is the perception of loudness of one sound rel- 
ative to another. One generally accepted loudness rela- 
tion for human hearing, also published in Davis et. al., 
holds that each 10 dB increase (or decrease) in SPL of 
a sound source increases (or decreases) the perceived 
loudness by a factor of two. For two levels A| and meas- 
ured in dB-SPL, the change in loudness in going from 
level /1 to level / 2 is therefore: 



Change in Loudness = 2 (/ 2 



(2) 



The curves of Figs. 2-4 are decibel-graduated. To 
convert these to a proper weighting function for the least- 
squares framework, the scales must be offset to bring all 
values to at or above 0 dB. Then, (2) is used to transform 
the sensitivity readings to the desired loudness scale. 
The final weighting function is formed by combining mul* 
tiplicatively one or more individual such functions. Figs. 
5, 6 and 7 show loudness transformations of the sensi- 
tivity curves of Figs; 2, 3 and 4 respectively. These data 
may then be used to design improved tap profiles. 

One such tap profile design is based on a desired 
uniform (flat) profile depicted in Fig. 8. which shows a 
plot for a uniform echo path compensation of 250 msec 
(tor 2 msec per tap granularity). The size of this profile 
in number of taps is 3500 (28*125), which is significantly 
greater than the number of taps economically feasible in 
typical current hardware implementations. Fig. 8 shows 
two optimal tap designs for this desired profile. The first 
uses only the hearing sensitivity weighting function of 
Fig. 6. The second uses a composite (specifically, a prod- 
uct) of hearing sensitivity as in Fig. 6 and the long-term 
speech power weighting as in Fig. 5. Because in this 
example the desired profile is flat, the echo perception 
weighting is not applicable: that is, all .subbands are 
weighted equally with respect to echo annoyance. Con- 
sidering the optimal profile for hearing sensitivity weight- 
ing only, it is seen that the optimal profile reflects the 
shape of Fig. 6. As a result, the bulk of the available taps 
are concentrated in the mid-band region where hearing 
is most sensitive. When the long-term speech power 
weighting function is combined with the hearing sensitiv- 
ity weighting function, a marked bias toward the lower 
subbands occurs. A small hump in the optimal profile in 
the mid-band region remains, as a result of pronounced 
hearing sensitivity weighting in this region. 



A second example of an improved tap profile is illus- 
trated in Fig. 9 wherein there are 2550 total taps in the 
desired tap profile. This profile was derived from meas- 
urements on a small collection of typical rooms and rep- 

5 resents an approximate bound on the -60dB 
reverberation level for these rooms as a function of fre- 
quency. This -60dB response boundary of the impulse 
response happens to decay essentially monotonically in 
frequency, and the reverberation time along this contour 

10 is approximately coincident with the desired profile plot- 
ted in Fig. 9. 

For this desired profile, four optimal filter tap designs 
were performed, the results of which are also shown in 
Fig. 9 (contrasting graphics are used to differentiate the 

is separate designs). The first two designs use the same 
weightings as the two designs in the preceding example. 
The third design uses a composite of hearing sensitivity 
as in Fig. 6 and echo perception as in Fig. 7. The fourth 
design uses a composite of hearing sensitivity as in Fig. 

20 6. speech power weighting as in Fig. 5 and echo percep- 
tion as in Fig. 7. The echo perception weighting is appli- 
cable in this second example because the desired filter 
tap profile is non-uniform 

The designs resulting from the hearing sensitivity 

25 weighting and combined hearing and speech weightings 
show results similar to those achieved for the uniform 
(flat) profile design of the first example. Importantly, the 
third and fourth designs of the second example, which 
combine additionally the echo perception sensitivity 

30 weighting, show a subtle but real effect of the impressing 
upon the tap profile design the human ear's sensitivity to 
echoes of longer delay: that is, the profile is advanta- 
geously further skewed toward the lower-most sub- 
bands. 

35 A generalized machine-implementable configura- 
tion for performing the above-described optimization for 
a subband echo canceller servicing a given room in 
accordance with the invention, is shown in Fig. 10 Sim- 
ilar in functionality to Fig. 1 , the machine also includes a 

40 computational unit 41 which hosts in software a set of 
subroutines executing the optimization procedure 
already described. Three further quantities are required 
to compute the optimal filter tap profile. These are: the 
room acoustic impulse response as a function of time 

45 (delay) and frequency as measured over the time-fre- 
quency range for which the echo canceller cancels 
echos; the total number of feasible subband adaptive f il- 
ter taps, N T , in (1) that can be accommodated by the echo 
canceller; and a stored list of weights { wj to be included 

so in (1) representing the composite perceptual loudness 
weighting functions used in the optimization. 

The room acoustic impulse response function can 
be measured locally automatically by the addition of an 
impulse response test unit 40 shown in Fig. 1 0 which may 

55 implement any of a number of well-known room impulse 
response measurement techniques such as that 
described, for example, in the noted publication of Davis 
ei al. With the addition of unit 40, the room impulse 
response can also be adjusted periodically to update for 
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numerous possible short-term physical changes in the 
room such as the presence of conferees, presentation 
props, the drawing of window drapes, etc.. all of which 
affect the room's acoustic properties. If the added com- 
putational requirement of test unit 40 is not economically 
practical, the room acoustic impulse response function 
may be supplied using data on standard conferencing 
rooms as in the earlier examples. 

The impulse response then is condensed to the 
desired tap profile by appropriate computations in com- 
puter unit 41 resident in the canceller 10, yielding the 
term {d$ in expression (1). Next, the optimum tap profile 
{nj is computed using a selected stored weight list con- 
taining terms { wj. Finally, the computed {nj are assigned 
to the subband adaptive filters {nj of the echo canceller. 

One advantageous specific hardware implementa- 
tion of the functionalities described above may use one 
or more digital signal processors such as the WE 
DSP32C available from AT&T, Inc. This and like DSP 
devices can host the AEC fater tap profile optimization 
process software, as well as perform the above proce- 
dures. One specific design adaptable to practice the 
present invention using digital signal processors, is the 
design shown in Fig. 8 of the article entitled "Acoustic 
Echo Cancellation Using Multirate Techniques", IEICE 
Transactions, Perez, H. and Amano. F. Vol. E 74 No. 1 1 
November 1991, which is hereby incorporated by refer- 
ence. 

In accordance with a further aspect of the invention, 
the short-term unvoiced sibilants ('s' sounds) generated 
in real time by the far-end speaker, which are a frequent 
contributor to annoying return echo, can be effectively 
reduced using a variation of the preceding techniques. 
Sibilant energy is characterized by a relatively unique 
waveform signature containing short-duration, high- 
energy bursts in the frequency range of from about 2000 
to 5000 Hz. The presence of sibilant energy may there- 
fore be detected in real time in the appropriate subbartds, 
and additional filter tap adjustments made by impressing 
onto the tap weighting {w} for the high frequency sub- 
bands additional weightings for the duration of the sibi- 
lant peak, in a manner similar to that described with 
respect to Figs. 5-7. These weightings may be con- 
structed using published or measured information on sib- 
ilant energy content m telecommunications conferencing 
systems far-end speech. 

Alternatively, the sibilant energy content of the tar- 
end speaker's voice may be actively measured and real- 
time active tap adjustments made in affected subbands 
as a function of the measured sibilant peak values. Fig. 
1 1 shows a variation of the subband analyzer 1 7 of Fig. 
1 which practices this concept. It comprises a detector 
30 for determining presence of sibilant energy by meas- 
uring, for example, the near-instantaneous power level 
of the sibilant energy burst within its spectrum. A thresh- 
old circuit 31 determines when the relative power of the 
sibilant energy is at or above a certain value with respect 
to the power in the remaining spectrum or some portion 
thereof, and generates a trigger signal in response 



thereto. The adaptive filter tap weightings which drive the 
individual taps of the adaptive filter bank 19, and which 
are previously set at the values for any of the examples 
above, are stored in a table store 33 which is a local data 

5 base integral with the canceller 1 0. In response to a trig- 
ger signal from threshold circuit 31 , the power level indi- 
cia of the sibilant energy in the various detection 
subbands is forwarded to converter 32 where the indicia 
are converted to tap weighting value adjustments. These 

70 are then forwarded to a controller 34 which momentarily 
reallocates the subband taps in adaptive filter bankl 9 to 
concentrate more filtering in the detected sibilant fre- 
quency range. Controller 34 also places the additional 
weights into store 33 which re-optimizes the weightings 

75 to include the sibilant adjustments. When the sibilant 
energy burst passes, the detector 30 and threshold cir- 
cuit 31 deactivate and the tap allocation and weights are 
returned to their normal values and configurations. This 
adjustment occurs whenever sibilant energy of sufficient 

20 power is detected, 

A process flow chart demonstrating the combining 
of the preceding overall steps is found in Fig. 12. 

Claims 

25 

1 . A subband acoustic echo canceller for a telecommu- 
nications teleconferencing room connected to a far- 
end station through incoming and outgoing signal 
paths, said canceller comprising: 

30 a plurality of adaptive f iter taps connected to 

said subbands; and 

means for allocating said taps among said 
subbands based on weighting functions which are a 
composite of both physical acoustic factors of said 

35 room and of perceived human sensitivity factors. 

2. Apparatus in accordance with Claim 1 , wherein said 
allocating means comprises: 

data store means for establishing a tap 
40 weight profile for said subbands; and 

means for inputting to said data store means 
a first set of fixed data related to the acoustic impulse 
response function of said room, and a second set of 
fixed data relating to the relative speech power spec- 
45 trum for male and female speakers, said first and 
second sets of fixed data being incorporated into 
said tap weights thereby to concentrate said taps in 
the peak energy containing lower ones of said sub- 
bands. 

so 

3. Aparatus in accordance with Claim 2, further com- 
prising means for detecting sibilant energy in said 
incoming path, and means for converting said 
detected sibilant energy into a temporary adjust- 

55 ment of said fixed data-based tap weight profile, to 
momentarily concentrate taps in subbands contain- 
ing said sibilant energy. 
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4. Aparatus in accordance with Claim 2, further com- 
prising: 

means for detecting sibilant energy in said 
incoming path originating at said far-end station; 

means for converting said detected sibilant 5 
energy into a further adjustment of said tap weight 
profile to temporarily increase the taps allocated to 
frequencies characteristic of said detected sibilant 
energy; and 

means for returning said tap weights to their 10 
previous values following passage of said sibilant 
energy. 

5. A subband acoustic echo canceller for a telecommu- 
nications teleconferencing room having incoming 15 
and outgoing signal paths connecting said room to 
one or more far-end stations, said echo canceller 
comprising: 

a plurality of subband adaptive filters; 

a plurality of adaptive filter taps associated 20 
with said subbands; 

a data store containing a weight list for con- 
trolling allocation of said taps among said subbands; 

means for estimating the acoustic impulse 
response of said room and for condensing same to 25 
a desired subband filter tap profile; 

means including said weight list for comput- 
ing an optimum tap profile based on said desired tap 
prof ile which includes adjustments based on one or 
more measures of perceived human acoustic sensi- 30 
tivity experienced by the far-end users; and 

means for applying said computed optimum 
tap profile to said subband adaptive filters of said 
echo canceller. 

35 

6. A subband acoustic echo canceller in accordance 
with Claim 5, further comprising means for impress- 
ing onto said data store weight list indicia of human 
speech power weightings to concentrate at least 
some available filter taps to subbands operating at 40 
frequencies at and below substantially 1000 Hz. 

7. An echo canceller in accordance with Claim 6, fur- 
ther comprising means for impressing onto said data 
store weight list indicia of human hearing sensitivity 45 
weightings. 

8. An echo canceller in accordance with Claim 6, fur- 
ther comprising means for impressing onto said data 
store weight list an adjustment that is a product of so 
human hearing sensitivity weighting and of long- 
term speech power weighting. 

9. An echo canceller in accordance with Claim 8. fur- 
ther comprising means for impressing onto said data ss 
store weight list indicia of echo perception weight- 
ings representative of the human ear's sensitivity to 
echoes of relatively longer delay. 




10. An echo canceller in accordance with Claims 5. 6, 
7. 8, or 9. further comprising: 

means for detecting sibilant energy in said 
incoming path; 

means for converting said detected sibilant 
energy into a further adjustment of said weight list 
to temporarily increase the taps allocated to fre- 
quencies characteristic of said detected sibilant 
energy; and 

means for returning said tap weights to their 
previous values following passage of said sibilant 
energy. 

1 1 . An echo canceller in accordance with Claim 1 0. fur- 
ther comprising means for actively periodically 
measuring the acoustic impulse response of said 
room and for condensing same to said desired sub- 
band filter tap profile. 
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FIG. 2 
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FIG. 6 



PERCEIVED 
LOUDNESS 



10 

0.9 
0.8 

0.7 
0.6 
0.5 
0.4 
0.3 
0.2 
0.1 
0 

























































































\ 


\ 


































\ 







































0 1000 2000 3000 4000 5000 6000 7000 8000 
FREQUENCY (Hz) 



FIG. 7 



PERCEIVED 
LOUDNESS 




50 100 150 200 250 300 
FREQUENCY (Hz) 



QMJ^DOCJD: <EP 0719028A2J_> 



10 



EP 0 719 028 A2 



FIG. 8 
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